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Abstract —We address noisy message-passing decoding of low- 
density parity-check (LDPC) codes over additive white Gaus¬ 
sian noise channels. Message-passing decoders in which certain 
processing units iteratively exchange messages are common for 
decoding LDPC codes. The exchanged messages are in general 
subject to Internal noise in hardware Implementation of these 
decoders. We model the internal decoder noise as additive white 
Gaussian noise (AWGN) degrading exchanged messages. Using 
Gaussian approximation of the exchanged messages, we perform 
a two-dimensional density evolution analysis for the noisy LDPC 
decoder. This makes it possible to track both the mean, and 
the variance of the exchanged message densities, and hence, to 
quantify the threshold of the LDPC code in the presence of 
internal decoder noise. The numerical and simulation results are 
presented that quantify the performance loss due to the internal 
decoder noise. To partially compensate this performance loss, 
we propose a simple method, based on EXIT chart analysis, 
to design robust irregular LDPC codes. The simulation results 
indicate that the designed codes can indeed compensate part of 
the performance loss due to the Internal decoder noise. 

I. Introduction 

OW-density parity-check (LDPC) codes - first discov¬ 
ered by Gallager HI and rediscovered by Spielman et 
al. El and MacKay et al. 0, a - due to their outstand¬ 
ing performance have attracted much interest and have been 
studied extensively during the recent years. They have also 
been included in several wireless communication standards, 
e.g., DVB-S2 and IEEE 802.16e fS], fh). Effective decoding of 
LDPC codes can be accomplished by using iterative message¬ 
passing schemes such as belief-propagation algorithm or sum 
product algorithm 0. Moreover, powerful analytical tools 
including EXIT chart analysis El, El and density evolution 
analysis na are developed for designing LDPC codes and 
quantifying their performance limits. 

The sum-product algorithm is based on elementary com¬ 
putations using sum-product modules im. These modules 
can be implemented using digital circuits or analog circuits. 
The digital implementation of sum-product modules for LDPC 
decoding, e.g., the one presented in ifT^ . is subject to noisy 
message passing due to the quantization of messages. The 
impact of quantization error on LDPC decoding performance 
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is investigated in IfTSlI . where the simulations indicate the 
resulting substantial performance degradation. Quantization 
error is often modeled as an additive noise and is assumed 
Gaussian under certain conditions llT4l . In lITSll . Varshney 
considers the impact of quantization error on message passing 
algorithm, and suggests a signal-independent additive trun¬ 
cated Gaussian noise model. More recently, Leduc-Primeau et 
al. studied the impact of timing deviations (faults) on digital 
LDPC decoder circuits in ifT^ . They model the deviations 
as additive noise to the messages passed in the decoder, and 
show that under certain conditions the noise can be assumed 
Gaussian. 

Loeliger et al. in Ha and Hagenauer and Winklhofer in 
iflTll introduced soft gates in order to implement sum-product 
modules using analog transistor circuits. They have also shown 
that by the variations of a single basic circuit, the entire family 
of sum-product modules can be implemented. Using these 
circuits, any network of sum-product modules, in particular, 
iterative decoder of LDPC codes can be directly implemented 
in analog very-large-scale integrated (VLSI) circuits. In analog 
decoders, the exchanged messages are in general subject to 
additive intrinsic noise. The power of the noise depends in part 
on the chip temperature ifTsl . To capture this phenomenon, in 
M Koch et al. considered a channel that is subject to an 
additive white Gaussian noise. This channel is motivated by 
point-to-point communication between two terminals that are 
embedded in the same chip. Therefore, the internal decoder 
noise may affect the communication of soft gates, and hence 
degrades the performance of the iterative analog decoder. 

Since in practice digital or analog LDPC decoders are 
subject to internal noise, the impact of this noise on the 
performance of iterative decoding needs to be investigated. 
Performance analysis of noisy LDPC decoding has attracted 
extensive interest recently (see e.g. ca, HD-ESl and the 
references therein). The performance of a noisy bit-flipping 
LDPC decoder over a binary symmetric channel (BSC) is 
studied in ifTSll . In this setting, the decoder messages are 
exchanged over binary symmetric internal channels between 
the variable nodes and the check nodes. It has been shown 
that the performance degrades smoothly as the decoder noise 
probability increases. Tabatabaei et al. studied the performance 
limits of LDPC decoder when it is subject to transient pro¬ 
cessor error m, ED- This research was further generalized 
in Ea by considering both transient processor errors and 
permanent memory errors, using density evolution analysis for 
regular LDPC codes. 

In this paper, we analyze the performance of LDPC codes 
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Fig. 1. Tanner graph of a regular (3, 6) LDPC code, where squares denote 
check nodes and circles denote variable nodes. 



Fig. 2. Message flow through a variable node (a), and through a check node 
(b). 


transmitted over an AWGN communication channel, when 
a sum-product decoding algorithm is employed in which 
exchanged messages are degraded by independent additive 
white Gaussian noise. We hrst invoke a density evolution 
(DE) analysis to track the probability distribution of exchanged 
messages during decoding, and quantify the performance 
degradation due to the decoder noise. We compute the density 
evolution equations for both regular and irregular LDPC codes. 
Also, we introduce an algorithm to hnd the EXIT curves of a 
noisy decoder. Einally we propose an algorithm for the design 
of robust irregular LDPC codes using EXIT chart for noisy 
decoders to partially compensate the performance loss due to 
the internal decoder noise. 

This paper is organized as follows. In Section [II] we present 
the dehnitions and model for noisy message-passing decoder. 
In Section [1111 we derive the density evolution equations for 
the noisy message-passing decoder. Next, numerical results of 
the density evolution analysis and simulation results of finite- 
length codes are presented. In Section |Iy] EXIT chart analysis 
of the noisy decoder is presented. Using the EXIT charts, 
a method for designing robust codes for the noisy decoder 
is presented in Section |V] Einally, Section |VT] concludes the 
paper. 

II. LDPC Codes and Noisy Message-Passing 
Decoding Principles 

Consider a regular binary {dv,dc) LDPC code with length 
N. The code can be represented hy a K x N parity check 
matrix H with binary elements, where the weight of each 
column and row of the matrix are and dc, respectively. 
There is a Tanner graph corresponding to the parity check 
matrix with N variable nodes and K ^ check nodes. 

Every variable node in the graph is connected to dy check 
nodes and every check node is connected to dc variable nodes. 
Corresponding to the ones in the columns and the rows of H, 
the variable nodes and the check nodes are connected to each 
other in the Tanner graph. Eig. [T] exemplihes a Tanner graph 
for a regular (3,6) LDPC code with length N. Variable node 
Vi and check node Cj are known as neighbors, if they are 
connected to each other. 

Message-passing decoding algorithm can be represented as 
iterative exchange of messages between check nodes and vari¬ 
able nodes of the Tanner graph. Specihcally, every check node 
receives messages from its dc neighbor variable nodes and 


sends the computed messages back. Similarly, each variable 
node exchanges messages with its dy neighbor check nodes. 

We consider the output messages of the variable and check 
nodes as log-likelihood ratio (LLR) values, where the sign 
of a variable node message specifies the bit estimate and its 
magnitude indicates the reliability of the estimation. 

According to the sum-product decoding algorithm, the mes¬ 
sage at iteration I from a variable node to a check node, 
denoted by is 




' = 


2=0 


( 1 ) 


where i = I,..., dy — 1, are incoming LLRs from 

variable node neighbors at iteration I — 1, except the check 
node that is to receive the output message and uq is the 
incoming LLR message from the communication channel. The 
message from a check node to a variable node at iteration 
I can be obtained as follows 


tanh 


(]\ dc — 1 (0 

^ -r-r . , 


= tanh ■ 


( 2 ) 


2=1 


Eig. |2] shows the schematics of message-passing for a variable 
node and a check node. 

Eor a noisy decoder, the output messages of the variable 
and check nodes are subject to additive white Gaussian noise. 
The conventional model shown in Eig. |2] can be extended to 
the one in Eig. 0 where rii and denote the additive white 
Gaussian noise affecting the output messages of check nodes 
and variable nodes, respectively. Hence, 7 j and are noisy 
versions of Vj and Ui, respectively. Therefore, the incoming 
messages to the variable nodes and the check nodes are 


(0 (0 , 

di = U]' + Ui , 

(0 (0 , 

Tj = + ^2 ’ 


(3) 

(4) 


where rii and Vj are assumed to be independent and identically 
distributed (i.i.d.), i.e., rii, Vj ~ A/'(0, cr^). 

According to the sum-product algorithm, at iteration I 
the decoding is performed based on the following updating 
equations 

2 = 1 


( 5 ) 
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Fig. 3. The model of (a) a variable node (b) a check node in noisy belief- 
propagation decoder. 


tanh • 


,,(0 


dc — 1 


v(o 


= tanh■ 


( 6 ) 


i=i 


In order to generalize these equations to irregular case one 
can follow the same steps as the one described in Q. In the 
next section, we propose an approach for the performance 
analysis of this noisy message-passing decoding algorithm. 


III. Density Evolution Analysis of Noisy Decoder 

In this section, using Gaussian approximation, we will find 
the density evolution equations for the noisy decoder with 
regular variable and check degrees. We further generalize 
the results to the irregular case, and finally use the derived 
density evolution equations to evaluate the performance of 
noisy decoders. 


shift keying (BPSK) modulation. Thus, the LLR values re¬ 
ceived over an AWGN communication channel are Gaussian 
distributed. The mean and the variance of the received LLR 
values are respectively equal to toq = and ctq = ^, 
where cr^ is the channel noise variance Q. We assume that the 
random variables u, v, Ui and vj are all Gaussian distributed. 
Lirst, we check whether the messages of a noisy sum-product 
LDPC decoder are consistent. To this end, we consider the 
expected values of both sides of (O and (|5]l and obtain 


= mo + (fi„ - (7) 


where rriv'^ and mu~^^ denote the means of output messages 
of variable nodes and check nodes, respectively. The index 
i is omitted since Ui, i = 1,... ,dv — 1, are i.i.d. Next, by 
computing the variances of both sides of (O we have 



= cr„ 






( 8 ) 


Using (|5]l, we obtain the variance of the variable node output 


2(0 


- var 


dv-l 

E 

2=1 


d^-1 

-f 2cov( uo, ^ 


(9) 


where var(X) denotes the variance of random variable X, 
and cov(X, y) is the covariance of random variables X and 
Y. Since /x^, i = — 1, are i.i.d. Gaussian random 

variables, we have 


var 


d^-l 


2=1 


d^-l 


2=1 


^ pr>) = ^ =(4 - 

( 10 ) 


A. Gaussian Approximation and Consistency 

The density evolution analysis is an analytical method for 
tracking the densities of messages in iterative decoders. This 
can be used to predict the performance limits of an LDPC 
code measured by code’s threshold ll24l . The code’s threshold 
is the smallest (largest) communication channel SNR (noise 
variance) for which an arbitrarily small decoding bit-error 
probability can be achieved by sufficiently long codewords. 
Lor an AWGN communication channel and an LDPC sum- 
product decoder, the densities of the exchanged messages 
between the check nodes and the variable nodes can be 
approximated as Gaussian Q, ESI. Hence, these densities 
may be characterized only with their mean and variance. A 
Gaussian random variable whose variance is twice its mean 
is said to be consistent ina. The consistency assumption 
simplifies density evolution as a one-dimensional recursive 
equation based on the mean (or the variance) of the messages. 
In Q, this assumption is used for the DE analysis of a 
noiseless LDPC decoder, and subsequently, quantifying the 
threshold of the code. 

The key assumption in the density evolution analysis of 
noise-free decoders is that the code block length is sufficiently 
large, based on which it may be assumed that the Tanner 
graph of the LDPC code is cycle-free. Since the code is linear 
and the communication channel is symmetric, we consider 
the transmission of an all-one codeword using a binary phase 


The last term in (|9|l is zero, as the Tanner graph of the 
code is assumed to be cycle-free and ug is independent of the 
noisy messages. Therefore, the variance of a variable node 
output message at iteration I can be simplified as follows 

(dv - + {dv - . ( 11 ) 

To verify the consistency of the noisy decoder, we plug 
in aY = 2mv^ and = 2m„ into (fTTl i and 

compare it with (|7]i. It is clear that as long as is non¬ 
zero, the two quantities are not equal and hence the noisy 
LDPC decoder is not consistent. Therefore, it does not suffice 
to track only the mean values of the nodes’ output messages. 
Instead, it is required to track both the mean and the variance 
of nodes’ output messages. A similar situation has been 
shown in the simulation results of ll26l . when there is an 
incorrect estimation of the communication channel SNR at 
a (noiseless) LDPC decoder. However, since the code is linear 
and the communication channel is symmetric, sending all-one 
codeword is sufficient for statistical performance evaluation of 
the code ll26l . 

Lor an irregular LDPC code, the degree distribution of 
variable nodes is A(a:) = ^nd that of the check 

nodes is p{x) = 'Yi =2 where Xi and pi are the 

percentage of edges that are connected to variable nodes and 
check nodes of degree i, respectively. Dy is the maximum 
degree of variable nodes and Dy is the maximum degree of 
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TABLE I 

Relation Between the Threshold and Decoder Noise Variance 



SNR threshold SNRth 

(*^n)th 

0 

1.163 dB 

0.8744 

1 

2.835 dB 

0.7215 

2 

3.635 dB 

0.6580 

3 

4.185 dB 

0.6177 


check nodes. In this case, by similar steps as the ones for the 
regular LDPC codes, it can be shown that for the mean and 
the variance of a variable node of degree i at iteration I 

= "^0 + (i - ( 12 ) 

+ (* - + (* - (13) 

where rnl^\ and are the mean and the variance of a 

variable node of degree i at iteration I, respectively. From (fTZt 
and ( foi l it can be inferred that the consistency is not valid for 
the irregular case. 


B. Density Evolution with Gaussian Approximation for Noisy 
Message-Passing Decoder 


In the case of a noisy LDPC decoder, we have shown that 
consistency does not hold and we should track both the mean 
and the variance of nodes’ output messages. In order to do 
this, we use the key equations (|2l-(l8]l and (fTTl i. By computing 
the expected value of both sides of equation (|6]l, and noting 
that 7 ^* , j = 1 ,..., dc — 1 are i.i.d., we have 


E 


tanh ■ 


,(0 


rd-c — t 


= E 


tanh 

L j=i 




tanh ■ 


v(0 



(14) 


where 7^*1 is defined in (fUl and has the following distribution 


v(') 




fi) 


^ 2(0 , ^2', 


(15) 


follows 


/(m,cr^) = E 

tanh(l) 

g{m,a'^) = E 

tanh^ (f) 


(18) 


where X ^ These equations can be used to 

track and in the decoding iterations of a regular 

{dv,dc) LDPC for given values of communication channel 
noise variance and internal decoder noise variance. Because of 
non-linearity of the equations in (fTTl i. it is not easy to find a 
closed form expression for the mean and the variance at each 
iteration. As such, we resort to Monte-Carlo simulations to 
solve (fTTl i and adopt the semi-Gaussian approximation method 
used in EZl and D3. 

Similarly, for irregular LDPC codes, the message distri¬ 
butions are approximated by Gaussian mixture fTl. For each 
check node of degree i at iteration I we have 




Dv 




7=2 


2-1 


("1^, + o-d) 


f=2 


(19) 

and from Gaussian mixture equations, the density of check 
node in iteration I has the following mean and variance values 

Dc 

= X! . (20) 

i=2 


2(0 


Dc 




2 (0 


■ ( 21 ) 


Therefore, the DE can be found by solving ( fT9] l for a check 
node with degree i and the distribution of a check node is then 
found using (f20fl and (fTTfl . iteratively. 


C. Numerical Results of the Density Evolution Analysis 


Next, by computing the expected value of squared tanh 
rule, we obtain the second major equation as follows 


E 



E 


tanh 


v(0 



The density evolution can be obtained by simultaneously 
solving equations (fTTfl and ( fThl l. Specifically, representing 7 O) 
using (flSl l and mv\ from dTJ and ([II]l, we obtain the 
DE equations for check nodes as follows 


/ = (/ +^i)) 


(17) 


The auxiliary functions f(m,a'^) and g{m,a'^) are defined as 


We solve the density evolution equations iteratively for a 
(3, 6 ) regular LDPC code considering = 0 and = 0 
as initial conditions. This provides the mean and the variance 
of check nodes’ outputs and allows for the computation of the 
threshold for the given variances of internal decoder noise and 
communication channel noise. 

Table U shows the relation between the threshold and the 
internal decoder noise variance cr^ resulting from (fTTl i. It can 
be observed that the SNR threshold SNRth — (^)th increases 
as the internal decoder noise variance increases. This is in line 
with a similar observation in ifTSll on the performance of bit¬ 
flipping LDPC decoding in the presence of noisy message¬ 
passing over BSC channels, where the performance deterio¬ 
rates as the cross-over probability of the internal decoder noise 
increases. 
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Fig. 4. En'or probability performance of (3, 6) regular finite length code 
with decoder noise variance tr^. 

Simulation results confirm that our analytical results accu¬ 
rately predict the performance of finite-length codes as well. 
Fig. m depicts the simulation results for the performance of a 
finite-length (3,6) regular code with length N = 1008. It is 
evident that the threshold of this finite-length code is fairly 
the same as our analytical threshold for various values of the 
internal decoder noise variance cr^. One can use (l20l l and (l2Tll 
to also track the density of irregular LDPC codes for noisy 
decoder. 

In general, the presented analysis could be used to design 
irregular LDPC codes for noisy decoders. Since the problem 
of designing irregular LDPC codes by density evolution is not 
a convex problem, finding a good degree distribution requires 
complex computations and extensive search ll27l . Therefore, 
in the remaining sections after investigating the performance 
limits of the noisy decoder by means of EXIT chart, we 
will introduce a simple and effective method to design robust 
LDPC codes for the noisy decoder. 

IV. EXIT Chart Analysis of Noisy Decoder 

The EXIT chart analysis, first introduced in the pioneering 
work of ten Brink ll28l . is a powerful tool for analyzing the 
performance of iterative turbo techniques. It is mainly based 
on keeping track of the mutual information of channel input 
bits and variable node and check node outputs. 

Let X be a binary random variable denoting the BPSK 
modulated AWGN communication channel input which takes 
±1 values with equal probabilities. If f{y) is the probability 
density function (pdf) of the communication channel soft 
output Y, then, the mutual information of X and Y for a 
symmetric channel ED, m is 

In order to find the EXIT function of a noiseless decoder, 
the variable node and the check node EXIT functions can 



Fig. 5. Modification of decoder components (VND or CND) to noisy decoder 
components (NVND or NCND). 


Algorithm 1 EXIT curve for NVND 
1: Input: Ia, dv, cr^, a^, N 

2: Output: Ie 

3: X = 1, [length N BPSK modulated codeword] 

4: for k = 1 : N do [compute decoder LLR inputs] 

5: end for 

6: for 1 = 1: length(lA) do 

O-A = (lA(f)) , 

where 

J(cr) = l-/ e log 2 (l-f e 

J—oo v^TTCJ 

7: for j = 1 : do [compute a priori LLRs] 

AP(j) = ^ -f n, n - A/'(0, a\) 

8 : end for 

9: [compute noisy variable node outputs using Q] 

E = NVND (d„,AP,Y, al) 

10: [Compute extrinsic mutual information using (i22l l1 

Ie(*) =/(X,E) 

11 : end for 


be computed using a J-function H, which directly results 
from the consistency assumption of the decoder. Since this 
assumption is violated in the case of a noisy decoder, to 
compute the a priori and extrinsic mutual information, we 
compute these values according to the definition of mutual 
information. 

To obtain the EXIT curves for the noisy LDPC decoder, we 
use Algorithm [T] and the empirical distributions computed by 
running simulations for each degree of variable node and check 
node. Specifically for each decoder component, we compute 
the extrinsic mutual information /e corresponding to a priori 
mutual information /a for the noisy variable (check) node 
decoder. To maintain the desired structure of the iterative 
decoder jS) for the noisy decoder, we modified the variable 
nodes and check nodes as shown in Pig. |5] In fact, we have 
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Fig. 6. EXIT charts of (3, 6) regular LDPC code resulting from Algorithm [T] for SNR= 3 dB and different decoder noise variances cr^. 



Fig. 7. Empirical distributions of outputs of check (left) and variable (right) 
nodes for I a = 0.5, cr^ = 1 and SNR = 3 dB. 

considered decoder noise as a part of variable (check) nodes 
and call them noisy variable (check) node decoders, NVND 
(NCND). 

In Algorithm [T] the proposed method for finding the EXIT 
curve of NVND is described. The procedure of finding EXIT 
curves for the noisy check node is similar to that of the noisy 
variable node; however, for the check node the communication 
channel output is not fed to the check node, i.e., the only input 
of the noisy check node is the vector of a priori LLRs from 
variable nodes (AP). The presented algorithm is an extension 
of the algorithm 7.4 in OTI for Turbo codes. 

It is noteworthy that for a noiseless decoder, input messages 
to each decoder component (VND or CND) are modeled by 
Gaussian random variables of mean fiA and variance = 
2^a- Then the mutual information I a of each input message 
and the channel input X (a priori mutual information) can be 
computed using 

Ia = J (cta) • 

This relation implies a one-to-one mapping from each Ia to 
a a A (and consequently p^). However, for a noisy decoder 
there is not such a one-to-one mapping and for each Ia 
different sets of may be found. One way to tackle 

this problem is to assume consistency for input messages to 
the noisy components (NVND and NCND) as stated in step 
6 of Algorithm [1] and calculate each a priori LLR as in 
step 7. Then, the input messages to VND and CND are no 
longer consistent (since they are coiTupted with decoder noise). 
Since we simulate each decoder component separately, the 
assumption made does not affect the computation of EXIT 
curves for the other components, and as our experiments 
validate, the suggested approach provides very accurate EXIT 
curves. 

Fig- m illustrates the evolution of EXIT charts of (3,6) 
regular LDPC code for different values of decoder noise 
variance and for communication channel SNR 3 dB. Eor 


= 0, there is an open tunnel between the curves, and 
increasing to one makes the tunnel tighter. However, for 
= 2 and cr^ = 3 the variable and the check EXIT curves 
cross each other. The EXIT charts in Eig. |6] illustrate that the 
SNR threshold of (3, 6) regular LDPC code is less than 3 dB 
when = 0 and = 1 and is greater than 3 dB when 
= 2 and = 3. This is in line with the results obtained 
from the density evolution analysis, as shown in Table U 

Pig. Q depicts the empirical distributions f{y) for the 
outputs of NVND of degree dy = 3 and NCND of degree 
dc = 6, used in (l22T i to find the extrinsic mutual information 
/e. We observe that the distribution of the nodes’ outputs 
are light-tailed for the check node and normal-tailed for the 
variable node. This motivates the use of numerical integration 
in (I 22 I 1 by integrating over a limited integral domain. 

In the following section, we will use the EXIT curves 
resulting from Algorithm [T] to design robust LDPC codes for 
noisy decoders. 

V. Design oe Robust Irregular LDPC Codes for 
Noisy Decoder 

In this section, our goal is to design robust irregular LDPC 
codes for noisy decoder. The design procedure of LDPC codes 
is based on fitting EXIT curves corresponding to given variable 
and check degree distributions. In fS), for a noiseless decoder, 
right-regular LDPC codes are designed for a fixed check node 
degree of dc, by fitting a weighted sum of the EXIT curves 
of variable nodes to the check node EXIT curve. In this 
work, we design irregular LDPC codes and allow more than 
one degree for both variable nodes and check nodes. Our 
benchmark for comparisons are irregular LDPC codes with the 
same rates designed for a noiseless decoder in ll29l . We verify 
the performance of the designed codes by the simulations of 
finite-length LDPC codes. 

It is noteworthy that when the exchanged messages in the 
decoder are not consistent, the weighted sum of the EXIT 
chart curves of variable node and check node are not the exact 
curves of the irregular code. However, our simulation results 
indicate that this approach is accurate enough for the case with 
a noisy decoder. 

A. Code Design Algorithm 

Using the EXIT curves obtained from Algorithm [1] we 
propose a simple method for the design of irregular codes 
for the noisy decoder. Similar to the code design approach 
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Algorithm 2 Robust LDPC code design 
1: Input: dc, Dy, r, cr^, A, S 
2: Output: code C* = {p{x)*, X{x)*) 

3: initialize SNRth 

4: = (2rSNRth)”^ 

5: for 7 = 1 : M + 1 do 
6: a = 8(7) 

7: [compute EXIT curves of check nodes with degree 

8: dc — 1 and degree dc using Algorithm [T] 

9: [compute effective EXIT curve /a.ncnd using p{x) 

10: in ( 1^ 1 

11: [compute EXIT curves of variable nodes with degrees 

12 : dy = 2 to dy = Dy ustng Algorithm [2 

13: [check if there is a A(a;) such that C = {p{x), A(a:)) 

14: satisfies the constraints in (25)] 

15: if code C exists then 

16: SNRth = SNRth ~ A 

17: C* =C 

18: go to Step 4 

19: end if 

20 : end for 


proposed in 12^ . we restrict our attention to irregular codes 
with two consecutive check node degrees as 

p{x) = ax‘^'^~^ + {I — a)x‘^'^ , (23) 

and variable node degrees as 

Dy 

X{x) = ^ XiX^~^. (24) 

i=2 

The effective EXIT curve of a noisy irregular check (variable) 
node /a.ncnd (f^E.NVNo) is obtained by averaging over the 
EXIT curves of check (variable) nodes with constituent check 
(node) degrees Q. 

In this paper, we refer to a candidate code C — {p{x), X{x)) 
of rate r as a successful code for a given SNR, if it satisfies 
the following constraints 


i) A(l) = l, 

ii) p(l) = l, 


.. .^ , fo P(x)dx 

III) r = 1 -- , 

fo Kx)dx 

iv) /e.NVND f^A.NCND , 

(25) 


where the last constraint implies that the effective EXIT curve 
of its variable node lies above the effective EXIT curve of its 
check node. 

Eor a given code rate r, we are looking for the code 
C* = {p{x)*, X{x)*) corresponding to the threshold SNR, 
SNRth, i e., the minimum SNR for which there is a successful 
code. In Algorithm |2 we set the check node degree dc, the 
maximum variable node degree Dy, and design rate r. In order 
to speed up the design procedure, we let a take limited values 
in S = [0 : 1/M : 1]. Then, for a given SNRth, by varying 
a from zero to one, we check if there is a variable degree 
distribution A(a;), as in (i24l i. such that the constraints in (i25T l 


are satisfied. One way to do this is for each a to find /a.ncnd 
according to (12^ and check if there is a vector {X 2 , ■ ■ ■, Xoy) 
for which the constraints in (i25] l are feasible. If so, we form 
the code C = {p{x),X{x)). Subsequently, we reduce SNRth 
by A and the algorithm does another iteration; otherwise, it 
terminates and the successful code from the previous iteration 
is selected. 

The EXIT curves of a check node do not depend on SNRth; 
By changing SNRth, the EXIT curves of variable nodes, and 
consequently /e.nvnd are affected. Using this fact, the com¬ 
plexity of the proposed algorithm may be further reduced by 
pre-computing /a,ncnd for each value of a once and storing 
them before running the algorithm. In the following section, 
we will present some results illustrating the application of the 
proposed algorithm in the design of robust LDPC codes for 
noisy decoders. 


B. Design Examples 

Erom Table 1 of 1291 . for the maximum variable degree of 
four, the introduced code of rate one-half has two types of 
check nodes with degrees five and six. The threshold of this 
code is 0.8085 dB and has the following degree distributions 

A(x) = 0.384X -b 0.042a;^ -b 0.574a;^ 
p{x) = 0.241x4-b 0.759x^ 

However, when the decoder is not perfect, the threshold and 
also the performance of this code degrade. Eor instance, in 
noisy decoder the threshold has increased by about 1.7 dB 
and 2.5 dB for decoder noise variances cr^ = 0.5 and = 1, 
respectively. 

Considering the same constraints in check degree distri¬ 
bution and maximum variable degree, we have designed an 
irregular one-half rate LDPC code for the noisy decoder with 
= 0.5. Using Algorithm |2 we obtained code A with the 
following degree distributions 

X{x) = 0.453X-b 0.547x^ 
p(x) = 0.451x4 -b 0.549X® . 

Pig. H] shows the performance of Code A and the designed 
code in 1^ for different decoder noise variances. When 
= 0.5 (solid curves). Code A provides a better performance 
compared to the code in 1^ . By increasing the decoder noise 
variance to =0.7 (dashed curves) Code A still outperforms 
the code in li29l . while by decreasing the decoder noise 
variance to — 0.3 (dotted curves) the codes show almost 
the same performance. It is evident that Code A performs well 
when the decoder noise power varies in the proximity of the 
designed variance. It is noteworthy that in our simulations the 
Tanner graph of codes are free from cycles of length four. 
The maximum number of decoder iterations is set to 80, and 
for each SNR, the error probability is computed after a total 
number of 50 block errors occur. 

As another example of code design, considering the same 
constraints on degree distributions, we have designed an 
irregular code {Code B) for noisy decoder with cr^ = 1. The 
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Fig. 8. En'or probability performances of Code A and the code in [29] for Fig. 9. Error probability performances of Code B and the code in (29) for 
different decoder noise vaiiances, N = 10^. different decoder noise variances, N = 10"*. 


degree distributions of this code are 

A(a;) = 0.4808a;+ 0.5192a;3, 
p{x) = 0.553a;^ + 0.447a:^ 

Fig. |9] shows the simulation results of Code B and the designed 
code in [29] for different decoder noise variances. When cr^ = 
1 (solid curves). Code B shows better performance compared 
to the code in [29]. Similar observations are made when the 
decoder noise variance (dashed curves) increases to 1.2 or 
decreases to 0.8 (dotted curves). 

In the above designs, we considered two consecutive check 
degrees for a fair comparison with the code in 1291 . However, 
the presented approach may be used to design irregular LDPC 
codes with arbitrary check degrees as 

Da 

p = X! ■ 

i=2 

The constraints in ( i25] l remain linear and hence the same 
procedure still applies. We emphasize that the range of decoder 
internal noise power that we considered here (between 0 
and 1.2) is rather conservative. For a scalar quantization 
of a Gaussian random variable, a single bit change in the 
quantization bitrate scales the quantization noise variance by a 
factor of about 3.4 1^ . According to our simulation results, 
the proposed robust LDPC code design indicates a higher gain 
when the decoder internal noise power is stronger. 

VI. Conclusions 

We considered a noisy message-passing scheme for the 
decoding of LDPC codes over AWGN communication chan¬ 
nels. We modeled the internal decoder noise as additive white 
Gaussian and observed the inconsistency of the exchanged 
message densities in the iterative decoder. For the inconsistent 
LDPC decoder, a density evolution scheme was formulated 
to track both the mean and the variance of the messages 
exchanged in the decoder. We quantified the increase of the 


decoding threshold SNR as a consequence of the internal 
decoder noise based on a density evolution analysis. We also 
analyzed the performance of the noisy decoder using EXIT 
charts. We introduced an algorithm based on the computed 
EXIT charts to design robust irregular LDPC codes. The 
designed codes partially compensate the performance loss 
due to the decoder internal noise. In this work, we modeled 
the decoder noise as AWGN on the exchanged messages, 
however, an interesting future step is to incorporate other 
noise models possibly directly obtained from practical decoder 
implementations. One may also use this research to design 
codes that are robust to decoder internal noise whose power 
may vary in a given range depending on possible types of 
implementation. 
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